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A model proposed in 2004 using the non-Abelian discrete symmetry S3 for under- 
standing the flavor structure of quarks and leptons is updated, with special focus on 
the quark and scalar sectors. We show how the approximate residual symmetries of 
this model explain both the pattern of the quark mixing matrix and why the recently 
observed particle of 126 GeV at the Large Hadron Collider is so much like the one Higgs 
boson of the Standard Model. We identify the strongest phenomenological bounds on 
the scalar masses of this model, and predict a possibly observable decay b — > st~ 
but not b — > sr + /x~ . 



1 Introduction 



With the discovery [HE] of a particle of 126 GeV at the Large Hadron Collider (LHC) and no 
evidence for any others in a wide range of masses, extensions of the standard model are now 
severely constrained. In particular, if we want to understand the pattern of quark and lepton 
masses and their mixing in terms of a flavor symmetry, we are faced with a new theoretical 
challenge. In order to carry the flavor symmetry in the context of a renormalizable theory, 
new scalar multiplets are required. We now must have a good reason within the flavor model 
as to why the one observed light Higgs boson is so much like that of the Standard Model 
(SM). Of course we need also to understand within the same context of why the quark 
mixing matrix is nearly diagonal, whereas the neutrino (lepton) mixing matrix is close to 
tribimaximal. 

In 2004, the family structure of quarks and leptons was explained in a model [3] using 
the non-Abelian discrete symmetry 53. It has a symmetry breaking pattern designed to 
allow for small 2 — 3 mixing in the quark sector and near-maximal 2 — 3 mixing in the 
neutrino sector. Whereas all the basic details were described for both quarks and leptons, 
that paper dealt mainly with neutrino mixing, with the specific assumption of negligible e—\i 
mixing in the charged-lepton mass matrix, although this 1 — 2 mixing is generally allowed by 
the S3 symmetry and is unavoidable also in the quark sector. As a result of that arbitrary 
assumption, the neutrino mixing angle #13 was predicted to be very small: 0.02 ±0.01. Given 
that it has now been measured [U E] at about 0.16, this prediction based on that arbitrary 
assumption is certainly ruled out, and the observed value of #13 should be attributed to e — \i 
mixing within the context of this model. The Higgs sector of this leptonic model has also 
been studied P, [7] for its collider signatures. 

In this paper we study the quark sector itself in detail and show how the Higgs sector 
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is constrained by present data. In particular, we identify two approximate residual discrete 
Z2 symmetries, which allow the lightest scalar particle to be the observed 126 GeV particle, 
with the property that it is naturally very close to that of the SM. 

In Sec. 2 we present the S3 model of Ref . [3] , writing down specifically all the quark and 
Higgs representations. In Sec. 3 we discuss the c — t and s — b quark sectors and show how 
they align in a symmetry limit, and the resulting phenomeno logical constraint from these two 
sectors. In Sec. 4 we add the u and d quarks and discuss the full 3x3 quark mixing matrix. 
In Sec. 5 we consider the full scalar sector consisting of three Higgs doublets, and show how 
the one light neutral scalar of this sector resembles that of the standard model to a very 
good approximation, not being a result of fine tuning but based on symmetry. In Sec. 6 we 
derive the phenomenological constraint on the third Higgs doublet which is responsible for 
mixing the first family with the other two. In Sec. 7 we make a specific verifiable prediction 
of this model, i.e. b — > st~ fi + could have a branching fraction as large as 10~ 7 , whereas 
b — > sr + ji~ would be suppressed by a relative factor of m^/m^. In Sec. 8 we conclude. 

2 The S3 Model 

The smallest non-Abelian discrete symmetry is the group S3 of the permutation of three ob- 
jects. It has six elements, and is isomorphic to the symmetry group of the equilateral triangle 
(identity, rotations by ±27r/3, and three reflections). It has three irreducible representations 
1, !', 2, with the multiplication rules: 

1 x r = r, i'xi' = i, 2xi = 2, 2 x r = 2, (i) 

2x2 = 1 + 1' + 2. (2) 

The specific choice of 2 x 2 matrices for the 2 representation is only unique up to a uni- 
tary transformation. A particular practical and elegant one appeared in Ref. [8] which was 
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followed in Ref. [3]. For a review, see Ref. [9]. In this representation, if 

2, (3) 



a 2 J \b 2 



under 5*3, then 

/ at \ ( b\ 



«t]' U 



2; (4) 



so that 



and 



. / d 2 6 2 \ 

ai6 2 + a 2 6i~l, ai& 2 — a 2 6i ~ 1 , , ~2_, (5) 



ft ft// ^1^2 \ 

ai6i + a 2 6 2 ~I, a|6i — a 2 &2 ~ 1 , +r (6) 



a{6 2 

4&i 



The consequence of this representation is the elegant result that the trilinear combination 
a±biCi + a 2 6 2 c 2 is a singlet. 

Consider all quarks as left-handed fields, so that the usual right-handed ones are repre- 
sented by charge conjugates. Let Qi = (ui,di), then we assign as in Ref. [3] 

QiX,cf,c c ,s c ~ 1, t c , 6 C ~ 1' , fgj~2- ( 7 ) 

In analogy to the three quark families, there are also three Higgs doublets $j = (0°,0~) 
with assignments: 

~2, $ 3 ~1. (8) 
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3 The c — £ and s — 6 Quark Sectors 



In this sector, only $ 12 are involved in the Yukawa interactions, i.e. 



C Y = gtii^b + fy-^t + ^c^ + g^lb-^s)- (0 r t-0- c )]6 c 

+ + + (0+6 + 0+ S )]c c + - 0?c) + (0+6 - + S )]t c . (9) 
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Consider now the Higgs potential of $1,2- In addition to the S3 symmetrical term, we add a 
soft term which breaks S3, but preserves the discrete Zi symmetry $1 -H- $2- Hence, 

V12 = + $2^2) - f4(${$2 + $2*1) 

+ ^Ai($t$i + $ 2 $ 2 ) 2 + ^A 2 ($i$i - $ 2 <f 2 ) 2 + A 3 ($ t 1 $2)($2$i) • (10) 

This has a minimum with V\ = t> 2 = v — 123 GeV, where 

^ 2 -^ + (2A 1 + A 3 )^ 2 = 0. (11) 
As a result, the normalized physical scalar bosons and their masses are given by 

h° = Re(0! + 2 ) , m 2 (h°) = 2(2Ai + \ 3 )v 2 , (12) 

H° = Re(0x - 2 ) , m 2 (H°) = 2/x 2 + 2(2A 2 - \ 3 )v 2 , (13) 

A = Im(0!-0 2 ), m 2 (A) = 2/i 2 , (14) 

^ = 4^-^), m 2 ( J E ± ) = 2 /U 2 -2A 3 ^. (15) 
Note that without the /i 2 . term which breaks S3, A would be massless. 

Consider now the generic structure of the c — t and s — b mass matrices. They are of the 
form given by Eq. (12) in Ref. j3], i.e. 

M l*v -w\in -1N/W3, O N 

Since they are both diagonalized by the same 2x2 unitary matrix, there is no mismatch, 
and the quark mixing matrix is diagonal, explaining to a good first approximation what is 
observed. Note that this result is based on the symmetry breaking pattern S3 — > Z2. Now 
h° may be identified with the corresponding SM Higgs boson which couples to {m s /2v)ss 
and (mb/2v)bb, etc. 

As for H ± , H°, A, their Yukawa couplings are given by 



V2i 



fH° + iA\-' 
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sr 



+ 



V2v 



H + c L + 



'H° + iA" 



sl 



bn + h.c, etc. 



(17) 



Hence H° and A will contribute significantly to B s — B s mixing, with resulting bounds on 
their masses. The tree-level effective four-fermion interaction is given by 



4t> 2 \m 2 H m A 



1 \ , , s 2 . m s m b 

~2 I ( S iM + - — 



1 1 



4t> 2 



{s L b R )(s R b L ) 



It adds to the usual SM box-diagram contribution for 5 S — 5 S mixing. The two new effective 
four-quark operators are usually denoted by 2 and C 4 [10J, i.e. 



2 = (s L b R ) 2 , 



{s L b R )(s R b L ) . 



(19) 
(20) 



The matrix elements of the operators are calculated at the van, a mass scale and evolved to 
the hadronic scale by using the anomalous dimension matrices given in Ref. pTT], [12], [13] . The 
mass difference in the B s — B s system is then given by 



AM S = (AM S ) SM + (AM S ) C2 + (AM S ) C4 , 



(21) 



where 



1 mr 



2rriB a 4t> 2 \m 2 H m\ 



(AM 



1 m b m s ( 1 1 



BslOi 



12 \m b (n b ) + m s (fj, b ) 



2 \m b (fi b ) + m s (fx b ) 



m B s fk I B 2 ({i b ) , 
(22) 

m B a fk ] B ^b) ■ 
(23) 



For the bag model parameters we use the results from Ref. |14] estimated in the quenched 
approximation on the lattice = mf l ~ MOM = 4.6 GeV): 



B 2 (fx b ) =0.82, B 4 (/z 6 ) = 1.16, 



(24) 



Figure 1: B s — B s mixing constraint for the masses m# and > 1 TeV. Masses less than 
1 TeV require fine tunning to satisfy the constraint. 

and the running of Wilson coefficients given at the same scale [H]: 772(^6 ) — 2.03, r/ 4 (/ib) ~ 
3.23. The masses of the b quark and the s quark at the TeV scale are = 2.4 GeV and 
m s = 45 MeV, respectively. 

The current experimental value of Amg s is 116.4±0.5x 10~ 10 MeV [15] . which agrees with 
the SM prediction to about 10%. Hence we limit our new physics contribution to 11.6 x 10~ 10 
MeV. The allowed range for the masses of H and A Higgs bosons in the region greater than 
1 TeV is shown in Fig. 1. Smaller masses, although possible, require fine tunning to satisfy 
the experimental B s — B s bound. 

Note that in this approximation, there is no contribution to b — > s'y from the new scalars, 
because of a residual Z2 discrete symmetry under which (c, s) are even, whereas (H ± , H°, A) 
and (t, b) are odd. 
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4 The 3x3 Quark Mixing Matrix 



The introduction of the third Higgs doublet $3 will allow the u and d quarks to obtain mass, 
as well as mixing with the other quarks. Since these are all small, it is natural to assume 
that t>3 is small. (This also means that the $3 mass may be naturally large, as shown later.) 
In that case, the h° of Eq. (12) is still a very good approximation to the one physical Higgs 
boson h° SM of the SM, i.e. we have an explanation of why our specific three-Higgs doublet 
model has a mass eigenstate h° which is very close to h° SM . 



The 3x3 quark mass matrices are given by [3] 

/ giv 3 gjv 3 \ 

M d = gfv 2 -g$v 2 

V gfvi gfivj. ) 



(25) 



and 



\ 



(26) 



gfvl -g%v\ 
\ g\v* 2 g%v* J 

Note that V\, v 2 in M. d are replaced by v 2 , v\ in M. u . This means that for v\ 7^ v 2 , there will 



be a mismatch in the s — b and c — t sectors. Since m s « and m c << m t , these mass 

matrices are simply diagonalized on the left: Aid by 

(I \ (c d - Si 0\ 



where s'/c' = v 2 /v\, and Ai u by 



d -s' 



s d c d 

V 





1/ 



(27) 





(1 





^ 


( 


v u = 





s' 


-d 






u 


d 


s' J 









15 0\ 


1/ 



(28) 



We have rephased dn,SR,bR, UR,CR.tn as well as (u,d)i, (c,s)l so that only one complex 
phase 5 remains. Hence 

( 

5 W 6 C u 

01/ 



v ( 



CKM 



v.]v A 



c u s u e iS 0\ (I \ (c d s d 0\ 



\ 







d' s 



C"J 



Sd c d 
V 





1; 



/ c u c d + c"s u s d e lS -c u s d + c"s u c d e tS s"s u e lS \ 



(29) 

V s"s d -s"c d c" J 

where s"/c" = id 2 — s' 2 )/2s'c' . Using the 2012 Particle Data Group values [15] . we obtain 

s" = 0.04135, s u = 0.08489, s d = 0.20983, cos 5 = -5.47 x 10" 3 , (30) 

with the CP violating parameter 

J = s M c u s d Q(s") 2 c" sin 5 = 2.96 x 10~ 5 . (31) 

5 The Complete Higgs Sector 

To allow for v\ ^ v 2 , the symmetry $! $ 2 must be broken. This may be accomplished 
by adding to V\i of Eq. (10) the term /i|($|$i — § 2 § 2 ). The coefficient //§ may be chosen 
naturally small, because /ig = results in the extra Z 2 symmetry already discussed. In 
addition, we impose a new Z 2 symmetry so that $3 and (u, d)i are odd and all other fields 
are even on Z 2 . The purpose of this symmetry is to forbid the quartic term $3($i$2^i + 
$ 2 $|$ 2 ) + h.c. which is allowed by S3 (the reason for this will become clear later). However, 
we also allow this new Z 2 symmetry to be broken softly by the bilinear term /i|$g($i + 
$2) + h.c, which preserves the $1 <H- $ 2 interchange symmetry of Vi 2 . The complete scalar 
potential of this model is then 



^123 = V 12 + ~ $2*2) + m,m$ 3 + \ji 2 M($i + $ 2 ) + h.c.} 

+ ^A 4 (<1>3$3) 2 + A 5 ($ 3 $3)($ t i$i + $2^2) + A 6 $£($I$i + $ 2 $ 2 )$ 3 

+ [A r ($J$ 1 )($J$ 2 )+/i.c.]. (32) 



Consider first v± 7^ v 2 , this results in a deviation of h° from h° SM given by 

h'-h^ ^-^i^-^ H*, (33) 
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where {v\ - vl)/Av 2 = 0.0207 from s" = 0.04135 of Eq. (23). 
Consider now v 3 ^ 0. Since m\ > is assumed large, 

m 2 3 + (X 5 + X e )(vf + vi) + 2X 7 v 1 v 2 m§ ' 
and the mixing of fan with <pm + 2 _r is V3/ (2v). This results in 



The /i° of our model is thus naturally equal to h° SM in the symmetry limit v\ = v 2 and t>3 = 0, 
and the deviation is naturally suppressed for realistic values of v\ « v\ ~ v\. If the quartic 
scalar term forbidden by the new Z 2 symmetry exists, then h° — h° SM ~ (2v3/v)Ke((j)^) would 
replace Eq. (30). This means that h° exchange itself will contribute too much to K° — K° 
mixing. With the relation in Eq. (30), this contribution is negligible. 

6 Constraint on $3 

The exchange of 0° directly contributes to AMjf. The relevant effective interaction is given 
by 

S ^P^ (d L s R )(d R s L ). (36) 
t> 3 m 3 

This operator is again C 4 from Eq. (20), with the appropriate exchange of the quarks 
and the contribution to Amx is analogous to Eq. (23), i.e. 



(37) 



with fix = 2 GeV. The relevant parameters are taken from Ref. [T3] : 



Bf K M = ^( , ™* - f r ) B 4K (fi K ) = 19.31 , (38) 
2 \m s (fi K ) +m d (/j, K )J 
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where B^k^k) = 1-03 itself, and the running of the Wilson coefficient gives T]4jc{ij>k) = 
4.87 HSJ. 

Assuming that this contribution is no more than 20% of the experimental value AMk = 
3.483 ± 0.006 x 10~ 12 MeV p], we obtain 



If v 3 = 10 GeV, then m 3 > 6 TeV. 

So far, we have been able to show that h° is very close to h° SM , and that the other physical 
scalars are of order 1 to 10 TeV, from B s — B s and K° — K° mixing respectively. All other 
effective flavor-changing neutral-current interactions in the quark sector such as b — > 37 are 
suppressed. 

7 Specific Prediction 

Since the scalars of this model also have leptonic interactions, there are some lepton fla- 
vor violating processes in this model which are negligible in the SM. The corresponding 
Lagrangian to Eq. (17) for the fi — r sector is given by 



Hence b — > st fi + proceeds again through the exchange of H° + iA (but b — > sr + fi is 
suppressed by m 2 Jm*.). 

Experimentally the most interesting decay would be B s — > t + . The branching ratio 
for this decay can be written as 



v 3 m 3 > 6.0 x 10 4 GeV 2 . 



(39) 




(40) 



777. 

B s J B s 

64vr 
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2 
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+ 



(41) 



H 
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Log 10 (Br(B s -> r + /0) 




Figure 2: Prediction for B s — > t + /i lepton flavor violation process in our model, with the 
masses of H and A bosons constrained by the B s — B s mixing from Fig.l. 

We see in Fig. 2 that the branching ratio for this decay can be as high as 10~ 7 for masses 
of H and A bosons in the TeV range. This is a possible unique signature of this model. For 
the less realistic masses smaller than 1 TeV, the B s — > r + fi~ branching ratio can come up 
to 0(1(T 6 ). 

8 Conclusion 

In the post-Higgs era, any extension of the SM has to face the question of why it contains 
a light neutral scalar boson h so much like to h° SM , in addition to being consistent with 
a myriad of phenomenological precision measurements. We show how this is possible in a 
model [3] proposed in 2004 based on the non-Abelian discrete symmetry S3. It has three 
Higgs doublets, and yet one becomes almost exactly that of the SM because of two ap- 
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proximate residual Z2 symmetries. It also explains why the quark mixing matrix is nearly 
diagonal, with just enough parameters to fit the data precisely. The model is constrained 
principally by B s — B s and K° — K° mixing, and has the unique prediction of b — > st~ fi + 
with a branching fraction for B s — > t + decay as large as 10~ 7 , but a strong suppression 
by the factor m^/m^ for b — > sr + fi~ decay. 
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